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DETAILED ACTION 
Response to Arguments 

1 . Applicant's arguments filed 04/1 1/2008 have been fully considered but they are 
not persuasive. 

NOTE: Examiner acknowledges that claims 5 and 15 have been cancelled. 

Argument 1 (page 10 paragraph 2): 

• "With respect to Claim 10, Ehsani does not teach or suggest assigning an 
individual option wherein the option is supplied by a user during a user- 
directed creation of a speech recognition callflow, as recited in the 
amended claim. In a portion related to one cited in the Office Action, 
Ehsani describes "optimizing [a] phrase-based n-gram parse." (Ehasani, 
paragraph [0160]; see also paragraph [0162].) This optimizing, however, is 
not a user-directed process for creating a speech recognition callflow." 
Response to argument 1 : 

Examiner takes the position that Ehsani teaches the building of grammars, 
wherein a call flow design and editing option is intended for users. Ehsani 
teaches the user responses in the call flow design are automatically expanded 
into recognition grammars . A grammar includes the set of user responses to 
system prompts that the system can recognize and process accordinqlv . FIG. 5 
shows the type of network that needs to be generated to recognize the user 
response to the systems prompt "What kind of food do you like to eat?" For each 
user request, the grammar specifies the set of legitimate variants and supplies an 
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abstract meaning representation (e.g., "request restaurant information"). Note 
that the system will not recognize speech input that is not explicitly specified in 
the grammar. If the recognition system allows for probabilistic grammars, the 
Network Expander can supply frequency and other probabilistic bigram and 
trigram statistics to build such a grammar ([0223]). 

Further, Ehsani teaches an editor task for a user, wherein the grammar designer 
provides editing functionality at all stages in the design process . Initial call flow 
designs can be saved, retrieved, and changed in both graphical and text mode- 
After the network has been expanded, the designer can go back to the initial call 
flow design and edit the phrase variants retrieved bv the system . At this stage, 
most of the editing activity will consist of eliminating variants that don't fit the 
pragmatic context, and of completing phrase templates by accessing the 
supplemental databases provided by the system or by typing in the template 
fillers directly. The editor also permits review and modification of the meaning 
representations automatically supplied bv the system ([0223]). 

Argument 2 (page 11 paragraph 3) 

• "More fundamentally, Ehsani fails to provide for the generation of a new 
grammar, let alone one that is independent of an existing pre-built 
grammar" 
Response to argument 2: 



Application/Control Number: 10/726,102 Page 4 

Art Unit: 2626 

Examiner takes the position that Ehsani teaches that the present invention has a 
number of significant advantages over existing techniques for designing voice 
recognition grammars. Most significantly, it automates the most laborious 
aspects of recognition grammar design, namely, the need to generate, either bv 
anticipation or bv empirical sampling, potential variants of responses to anv given 
svstem prompt . Secondly, it eliminates the need for expensive user data 
collection and hand coding of recognition grammars. Thirdly, the invention 
allows developers without specialized linguistic knowledge to design much more 
complex networks than conventional design techniques can support . In sum, the 
invention enables a developer to create more complex and better performing 
systems in less time and with fewer resources ([0025]). 

Further Ehsani teaches that the invention is often described above as 
implemented to generate a recognition grammar for text data representing a 
form, such need not be the case. The invention can also be used to generate 
recognition grammars based on text data that enables navigation through, or 
retrieval of information from, the set of text data . For example, the invention can 
be used to create a recognition grammar based on an index of this document. A 
voice recognition system could then be implemented to make use of such a 
recognition grammar so that, for example, when a user said "Skip to the claims." 
the voice recognition svstem would understand and act on that statement bv the 
user ([0248]). 
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Ehsani also teaches that like the grammar design tool, the system provides a 
graphical interface for call-flow design and a large database of phrases for 
enabling the grammars to handle natural variations o f user input, e.g., different 
ways of phrasing a request for information ([0236]). 

Examiner takes the position that the user having the option to create a grammar 
in a call flow design allows for the creation of separate grammars relevant to 
various tasks, wherein new grammars can be constructed in addition to pre- 
existing grammars. The user can create grammar entries (i.e. options, such as 
recognizable requests, date, time, etc.) within a database that do not exist in 
order to specify a broad range information to handle a call in a flow system, 
wherein the call flow system was designed by the call flow designer/user. 

Argument 3 (page 12 paragraph 3): 

• "Moreover, as the above-quoted language reveals, Ehsani does not 
automatically generate a new grammar to hold the user-supplied new 
option if the individual option fails to match a recognition phrase or 
annotation in a pre-built grammar" 
Response to argument 3: 

Examiner takes the position that Ehsani teaches that the present invention has a 
number of significant advantages over existing techniques for designing voice 
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recognition grammars. IVlost significantly, it automates the most laborious 
aspects of recognition grammar design, namely, the need to generate, eitlier by 
anticipation or bv empirical sampling, potential variants of responses to any given 
system prompt . Secondly, it eliminates the need for expensive user data 
collection and hand coding of recognition grammars. Thirdly, the invention 
allows developers without specialized linguistic knowledge to design much more 
complex networks than conventional design techniques can support . In sum, the 
invention enables a developer to create more complex and better performing 
systems in less time and with fewer resources ([0025]). 

Further Ehsani teaches that the invention is often described above as 
implemented to generate a recognition grammar for text data representing a 
form, such need not be the case. The invention can also be used to generate 
recognition grammars based on text data that enables navigation through, or 
retrieval of information from, the set of text data . For example, the invention can 
be used to create a recognition grammar based on an index of this document. A 
voice recognition system could then be implemented to make use of such a 
recognition grammar so that, for example, when a user said "Skip to the claims." 
the voice recognition system would understand and act on that statement by the 
user ([0248]). 
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Ehsani also teaches that like the grammar design tool, the system provides a 
graphical interface for call-flow design and a large database of phrases for 
enabling the grammars to handle natural variations o f user input, e.g., different 
ways of phrasing a request for information ([0236]). 

Examiner takes the position that the user having the option to create a grammar 
in a call flow design allows for the creation of separate grammars relevant to 
various tasks, wherein new grammars can be constructed in addition but 
separately from pre-existing grammars. The user can create grammar entries 
(i.e. options, such as recognizable requests, date, time, etc.) within a database 
that do not exist in order to specify a broad range information to handle a call in a 
flow system, wherein the call flow system was designed by the call flow 
designer/user. 

Argument 4 (page 12 paragraph 3): 

• "Ehsani does not generate a new grammar that is independent of the pre- 
built grammar and automatically constructed to hold the new entry." 
Response to argument 4: 

Examiner takes the position that Ehsani teaches that the present invention has a 
number of significant advantages over existing techniques for designing voice 
recognition grammars. Most significantly, it automates the most laborious 
aspects of recognition grammar design, namely, the need to generate, either by 
anticipation or bv empirical sampling, potential variants of responses to any given 
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system prompt . Secondly, it eliminates the need for expensive user data 
collection and hand coding of recognition grammars. Thirdly, the invention 
allows developers without specialized linguistic knowledge to design much more 
complex networks than conventional design technicues can support . In sum, the 
invention enables a developer to create more complex and better performing 
systems in less time and with fewer resources ([0025]). 

Further Ehsani teaches that the invention is often described above as 
implemented to generate a recognition grammar for text data representing a 
form, such need not be the case. The invention can also be used to generate 
recognition grammars based on text data that enables navigation through, or 
retrieval of information from, the set of text data . For example, the invention can 
be used to create a recognition grammar based on an index of this document. A 
voice recognition system could then be implemented to make use of such a 
recognition grammar so that, for example, when a user said "Skip to the claims." 
the voice recognition svstem would understand and act on that statement bv the 
user ([0248]). 

Ehsani also teaches that like the grammar design tool, the svstem provides a 
graphical interface for call-flow design and a large database of phrases for 
enabling the grammars to handle natural variations o f user input, e.g., different 
ways of phrasing a request for information ([0236]). 
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Examiner tal<es the position tliat tine user liaving the option to create a grammar 
in a call flow design allows for the creation of separate grammars relevant to 
various tasks, wherein new grammars can be constructed in addition but 
separately from pre-existing grammars. The user can create grammar entries 
(i.e. options, such as recognizable requests, date, time, etc.) within a database 
that do not exist in order to specify a broad range information to handle a call in a 
flow system, wherein the call flow system was designed by the call flow 
designer/user. 

Argument 5 (page 13 paragraph 4): 

• "Accordingly, even when Ehsani is combined with Del Monte, the 
combination yet fails to teach or suggest a method or system that 
automatically generates a new grammar independent of a pre-built 
grammar to contain a user-supplied new option if the new option does not 
match any element of the pre-built grammar or an associated annotation 
associated with an element of the pre-built grammar, as recited in 
amended Claims 1,11, and 19" 
Response to argument 5: 

Natural Language Understanding component (component 2) extracts the 
meaning of the transcribed speech input and translates the utterances specified 
in the recognition grammar into a formalized set of instructions that can be 
processed by the application. In most simple systems, this is done via language 
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interpretation tags that are inserted manually into the grammar in such a way as 
to reduce the linguistic variants specified in a given recognition grammar to a 
single command that can be executed by the system. For example, the input 
variants "I'd like to order <title>," "Do you have <title>?," and "I'm 
looking for <title>" are reduced to a single instruction such as <search 
TITLE&gt([0214]). 

Examiner takes the position that Ehsani teaches that the present invention has a 
number of significant advantages over existing techniques for designing voice 
recognition grammars. Most significantly, it automates the most laborious 
aspects of recognition grammar design, namely, the need to generate, either bv 
anticipation or by empirical sampling, potential variants of responses to any given 
system prompt . Secondly, it eliminates the need for expensive user data 
collection and hand coding of recognition grammars. Thirdly, the invention 
allows developers without specialized linguistic knowledge to design much more 
complex networks than conventional design technioues can support . In sum, the 
invention enables a developer to create more complex and better performing 
systems in less time and with fewer resources ([0025]). 

Further Ehsani teaches that the invention is often described above as 
implemented to generate a recognition grammar for text data representing a 
form, such need not be the case. The invention can also be used to generate 
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recognition grammars based on text data that enables navigation through, or 
retrieval of information from, the set of text data . For example, the invention can 
be used to create a recognition grammar based on an index of this document. A 
voice recognition system could then be implemented to make use of such a 
recognition grammar so that, for example, when a user said "Skip to the claims." 
the voice recognition system would understand and act on that statement bv the 
user ([0248]). 

Ehsani also teaches that like the grammar design tool, the system provides a 
graphical interface for call-flow design and a large database of phrases for 
enabling the grammars to handle natural variations o f user input, e.g., different 
ways of phrasing a request for information ([0236]). 

Examiner takes the position that the user having the option to create a grammar 
in a call flow design allows for the creation of separate grammars relevant to 
various tasks, wherein new grammars can be constructed in addition but 
separately from pre-existing grammars. The user can create grammar entries 
(i.e. options, such as recognizable requests, date, time, etc.) within a database 
that do not exist in order to specify a broad range information to handle a call in a 
flow system, wherein the call flow system was designed by the call flow 
designer/user. 
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Claim Rejections - 35 USC § 102 

2. The following is a quotation of the appropriate paragraphs of 35 U.S.C. 1 02 that 
form the basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(e) the invention was described in (1 ) an application for patent, published under section 1 22(b), by 
another filed in the United States before the invention by the applicant for patent or (2) a patent 
granted on an application for patent by another filed in the United States before the invention by the 
applicant for patent, except that an international application filed under the treaty defined in section 
351 (a) shall have the effects for purposes of this subsection of an application filed in the United States 
only if the international application designated the United States and was published under Article 21(2) 
of such treaty in the English language. 

3. Claim 10 rejected under 35 U.S.C. 102(e) as being anticipated by Ehsani et al 
USPGPUB 20020032564 Al (hereinafter Ehsani). 

Re claim 10, Ehsani teaches a method for creating speech recognition callflow 
for an application ([0221]-[0225]), comprising the steps of: 

placing a symbolic representation of a prompt into a workspace of a graphical 
user interface for creating the speech recognition callflow for the application ([0221]- 
[0225]), said prompt defining a query requesting a value for a variable ([0221]-[0225] & 
Fig. 4), wherein said placing generates within said application an instruction to present 
said query to a user ([0024]); 

assigning an individual option ([0162]) supplied by the user during user-directed 
creation of the speech recognition callflow ([0221]-[0225]) and a pre-built grammar 
([0031] & Fig. 5) to the symbolically represented prompt ([0221]-[0225]), wherein said 
assigning generates within said application an instruction to process a speech Input 
responsive to said presented query, using at least one among said pre-built grammar 
and said new option ([0215]), wherein said pre-built grammar includes phrases 
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associated witli valid values for said variable, and wherein said new option comprises a 
user-defined phrase associated with a valid value for said variable ([0162]) 

if the individual option is a potential valid match to a recognition phrase or an 
annotation in the pre-built grammar, recognizing that the individual option is a potential 
valid match ([0162]) and responsively configuring the individual option to point to an 
entry in the pre-built grammar ([0198]); and 

if the individual option fails to be a potential valid match to the recognition phrase 
or the annotation ([0082]) in the pre-built grammar ([0162]), determining that the 
individual option fails to be a potential valid match and configuring the individual option 
as a new entry in a new grammar, the new grammar being independent of the pre-built 
grammar ([0223]) and automatically constructed to hold the new entry ([0162]), the new 
entry having text corresponding to text of the individual option ([0162]), the text of the 
new entry being both a recognition string and an associated annotation ([0082]). 

NOTE: For prior art purposes, an annotation is construed to be both functionally 
equivalent and effective as an abbreviation, date, time, and text. 

Claim Rejections - 35 USC § 103 

4. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or deschbed as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 



Application/Control Number: 10/726,102 Page 14 

Art Unit: 2626 

5. Claims 1-4, 6-9, 11-14, and 16-20 rejected under 35 U.S.C. 103(a) as being 
unpatentable over Ehsani et al USPGPUB 20020032564 A1 (hereinafter Ehsani) in view 
of Del Monte US 5704060 A (hereinafter Del Monte). 

Re claims 1,11, and 19, Ehsani teaches a method for creating a speech 
recognition application callflowfor an application ([0221]-[0225]), comprising the steps 
of: 

placing a symbolic representation of a prompt into a workspace of a graphical 
user interface for creating the speech recognition callflow for the application ([0221]- 
[0225] ]-[0225]), said prompt defining a query ([0221]-[0225] & Fig. 4), requesting a 
value for a variable, wherein said placing generates within said application an 
instruction to present said query to a user ([0024]); 

attaching to the prompt representation at least one among a pre-built grammar 
([0031] & Fig. 5) selected by a user and a user-entered ([0236]) individual new option 
entered by the user using the graphical user interface during creation of the speech 
recognition callflow ([0221]-[0225]), wherein said attaching generates within said 
application an instruction to process a speech input responsive to said presented query 
using at least one among said pre-built grammar and said new option ([0215]), wherein 
said pre-built grammar includes phrases associated with valid values for said variable, 
wherein said new option comprises a user-defined phrase associated with a valid value 
for said variable ([0162]); 

wherein, if the new option does not match any element of the pre-built grammar 
or an annotation associated with an element of the pre-built grammar, said processor is 
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progrannnned to automatically generate a new grammar independent of tlie pre-built 
grammar, tlie new grammar containing said new option ([0221]-[0225] and [0248]) 

However, Ehsani fails to teach repeating the steps of placing and attaching for 
each other request to be included in the callflow steps until the speech recognition 
callflow has been completed (Del Monte col 24 line 56 - col 25 line 18). 

Del Monte teaches a text storage and retrieval system where data is added to a 
list if it is not already present (215) and test conditions such as ranking (212) and 
threshold comparison (203) are performed. Del Monte also teaches a dictionary 
matching function 141 that compares words stored in the metafile's word vector table 21 
to the list of words stored in the standard and archive dictionary files 35, 36. If a match 
is found, the dictionary matching function 141 replaces the word in the word vector table 
21 with a reference to the dictionary entry containing the word. If a match is not found, 
the matching function 141 adds the word to the archive dictionary 36, and then replaces 
the word in the word vector table 21 with a reference to the new word in the dictionary 
36. During the dictionary matching process, the word vector table 21 is maintained in a 
sorted, ascending order, according to the magnitude of the dictionary references. 

Therefore, it would have been obvious to one of ordinary skill in the art at the 
time of the invention the repetition of the steps of placing a symbolic representation into 
a workspace of a graphical user interface for speech/voice recognition, where the user 
is queried for information relative to pre-built and new grammar. Repeating a 
procedure, particularly when the user is directly involved would be necessary to allow a 
database/grammar to be updated with new user entries, and can terminate when a 
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users list of information is concluded. A system that allows for current data to be 
retrieved as well as new data that can become part of a database/grammar would allow 
for a more robust recognition of speech when the application is performed in or our of 
edit mode, where a system can learn independently once a user edits the call flow for a 
voice application accordingly. 

Re claims 2, 12, and 20, Ehsani teaches the method of claim 1 , wherein the step 
of attaching the pre-built grammar comprises the step of selecting the pre-built grammar 
from a list of pre-built grammars ([0244]). 

Re claims 3 and 13, Ehsani teaches the method of claim 2, wherein the method 
further comprises the step of searching the list of pre-built grammars ([0086]) for 
matches to the user-entered individual new option ([0162]). 

Re claims 4 and 14, Ehsani teaches the method of claim 3, wherein if a match 
exists between a listed pre-built grammar and the user-entered ([0236]) individual new 
option ([0162]), then the user-entered individual new option ([0244]) points to an 
equivalent said matching pre-built grammar ([0198]). 

Re claims 6 and 16, Ehsani teaches the method of claim 1 , wherein the pre-built 
grammars are selected from the group comprising VoiceXML ([0231]) and custom-built 
grammars from a library ([0225]). 
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Re claims 7 and 17, Elisani teaclies tine metliod of claim 1 , wherein the method 
further comprises the step of enabling a customized user selective output ([0225]) of the 
pre-built grammar ([0244]). 

Re claim 8, Ehsani teaches the method of claim 1 , wherein the method supports 
prototyping without knowledge of a grammar structure by a user ([0162]). 

Re claims 9 and 18, Ehsani teaches the method of claim 3, wherein if no match 
exists between the list of pre-built grammars and the user-entered option, then the 
phrase in said option is added to said pre-built grammar ([0162]). 

Conclusion 

6. The prior art made of record and not relied upon is considered pertinent to 
applicant's disclosure US 6714905 B1, US 5617578 A, US 5940797 A, US 5812977 A, 
US 6064961 A, US 5903867 A, US 4864501 A, US 5970460 A. 

7. THIS ACTION IS MADE FINAL. Applicant is reminded of the extension of time 
policy as set forth in 37 CFR 1 .136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within 
TWO MONTHS of the mailing date of this final action and the advisory action is not 
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mailed until after the end of the THREE-MONTH shortened statutory period, then the 
shortened statutory period will expire on the date the advisory action is mailed, and any 
extension fee pursuant to 37 CFR 1 .136(a) will be calculated from the mailing date of 
the advisory action. In no event, however, will the statutory period for reply expire later 
than SIX MONTHS from the mailing date of this final action. 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Michael C. Colucci whose telephone number is (571)- 
270-1847. The examiner can normally be reached on 9:30 am - 6:00 pm, Monday- 
Friday. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Richemond Dorvil can be reached on (571 )-272-7602. The fax phone 
number for the organization where this application or proceeding is assigned is 571- 
273-8300. 
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Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 



/Michael C Colucci/ 
Examiner, Art Unit 2626 
Patent Examiner 
AU 2626 
(571)-270-1847 
Michael.Colucci@uspto.qov 

/Richemond Dorvil/ 

Supervisory Patent Examiner, Art Unit 2626 



